Data neural network system and method

ABSTRACT

This application discloses a neural network that also functions as a packet data network using an MPLS-type label switching technology. The neural network uses its intelligence to build and manage label switched paths (LSPs) to transport user packets and solve complex mathematical problems. This architecture is well suited to interconnect large numbers of processors or computers into a neural network exhibiting advanced intelligence which can be used for complex activities such as managing the power grid. However, the methods taught here can be applied to other data networks including ad-hoc, mobile, Information Centric, Content Centric, Sensor, and traditional IP packet networks, cell or frame-switched networks, time-slot networks and the like.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation-in-part of application Ser. No.14/019,309, filed Sep. 5, 2013 which is incorporated herein byreference, and is a continuation-in-part of application Ser. No.12/856,564, filed Aug. 13, 2010, now U.S. Pat. No. 8,547,981, which is acontinuation of application Ser. No. 11/696,077, filed Apr. 3, 2007, nowU.S. Pat. No. 7,796,511, which is incorporated herein by reference, andwhich claims the benefit of U.S. Provisional Application 60/790,430,filed Apr. 6, 2006, which is also incorporated herein by reference.

FIELD OF THE INVENTION

The field of this invention is the intersection of the artificialintelligence field, specifically neural networks, with the data networksfield, including data networks using label switching such as MPLS.However, the methods taught here can be applied to other data networksincluding ad-hoc, mobile, Information Centric, Content Centric, Sensor,and traditional IP packet networks, cell or frame-switched networks,time-slot networks and the like.

BACKGROUND OF THE INVENTION

Open Systems Interconnection (OSI) layers are known to those of skill inthe art as a series of protocol layers to define communications in datanetworks. The first layer relates to the physical aspects ofcommunication. Examples are T-1 and 100-base T. The second layer iscalled the data link layer. This layer is used to format data passingover a given link. Examples include Ethernet and HDLC. Layer 3 is calledthe network layer. This layer supports end-to-end packet delivery andthe most common example is the IP routing in the Internet. Layer 4, thetransport layer, provides end-to-end management of communications.

Networks that use a connection as the primary method of transportinginformation between two points are considered Layer 4 networks as Layer4 protocols such as TCP can manage connections directly.

To improve the efficiency of packet networks, label-switchingtechnologies such as frame relay, ATM, and MPLS have become popular forOSI layer 2 wide area networking. The short labels are popular withtelecommunication carriers as a more efficient alternative totraditional IP routing. The most popular of these technologies,multi-protocol label switching (MPLS), uses label switched paths “LSPs”to carry packet flows between edge nodes. Packets in these flows aretransported in a deterministic, orderly manner. In fact, transportschemes of this nature are so reliable that the term “pseudo wire” hasbeen used to describe this system. Through the use of MPLS, packet flowsthrough LSPs have been used to interconnect LANS (VLANS), support QOSand policy routing, and even switch synchronous services such as DS1s orDS3s.

Neural networks occur naturally and provide the intelligence of thehuman brain. Artificial Neural Networks (ANNs) are man-made networksused to solve complex problems. Details of these networks are describedin the following documents which are incorporated herein by reference:

-   Reference 1:-   Anil K. Jain and Jianchang Mao and K. M. Mohiuddin “Artificial    Neural Networks: A Tutorial,” Computer, March, 1996, pp. 31-44.    (available online)-   Reference 2:-   Vipan Kakkar “Comparative Study on Analog and Digital Neural    Networks” International Journal of Science and Network Security,    VOL. 9 No. 7, July 2009, pp. 14-21. (available online)    These two references will aid in providing the reader with the    background necessary to understand the neural network aspects of    this invention.

Many applications for ANNs exist. An important application lies in thecontrol of the power grid. As this area is complex, a third reference isadded.

-   Reference 3:-   U.S. Pat. No. 9,465,397 B2, Forbes

This reference will aid the reader in understanding the complex natureof the power grid, an excellent application for an ANN, and therefore isalso incorporated herein by reference.

ANNs and data communication networks have always been treated separatelyas the requirements and resultant functionality has always beendifferent. ANNs have traditionally been analog networks carryingvoltages that are multiplied using analog multipliers to achieve theneural network weighting functions. As these neurons contain noaddressing capability, they require a physical connection forcommunication, and can only communicate with their immediate neighbors.Lately, developers have been using software simulation to build neuralnetworks. These neural networks rely on their host computers which areserial devices and therefore slow compared with true parallel neuralnetworks. What is needed is a neural network technology that can sharethe connectivity benefits of today's packet networks.

RELATED ART

Today's OSI Layer 3 packet networks use distance oriented routingprotocols such as OSPF to determine routing trees or to build new paths.These protocols use computers that are part of the routers or nodes tocollect and process the data needed to make the routing decisions.Unlike the network of this application, the IP networks themselvespossess no intelligence capable of performing any of the routingdecisions, and must rely on external computers. The computers form arouting tree to determine a path through multiple nodes. Oncedetermined, this information is flooded to all the nodes so each nodecan forward its packets correctly.

Routing protocols originally relied on static parameters such asdistance vectors or total bandwidth of each link to make routingdecisions. These protocols were not able to take into account dynamicparameters such as congestion, policy or QOS. Recently much developmenteffort has gone into adapting the routing protocols to support thesedynamic parameters. Software Defined Networking (SDN) is an example of amethod of network control to allow support of complex networks. SDNrelies on a separate processor to control dumb switches and routers tosupport intelligent routing. Unfortunately, this technology falls shortif reliable links do not exist to the controller.

Packet networks utilizing these routing protocols can be considered ascommon control networks since the routing computers have knowledge ofthe network, and use that knowledge to make routing decisions.

Common control packet networks suffer from several problems:

-   -   1.) In real time the routing process can be slow compared to the        dynamic changes in the network metrics causing inaccurate or        erroneous decisions to be made. This is especially true in        ad-hoc or mobile networks that are constantly changing.    -   2.) Congestion or node failures in a packet network can prevent        essential information from arriving at the routing computer.    -   3.) Managing the flow of data through complex networks can be        difficult and expensive.    -   4.) Paths routed in this manner are not verified so may not be        reliable.    -   5.) Label switched paths (LSPs) routed in this manner may        contain loops.    -   6.) Real time routing decisions cannot be made in this way as        delays are too long to be practical for rapidly changing        computer network.    -   7.) Path information cannot be collected in times of severe        congestion.    -   8.) This type of routing cannot be used for load balancing as        the load balancing parameters change with each decision.    -   9.) As the network grows larger and more complex it becomes        difficult to make these routing decisions.    -   10.) Networks of this type are fundamentally insecure as routing        data must be shared in band.

For these reasons, many carriers have resorted to having their packetnetworks engineered by outside network engineering firms. It has beenfound that engineered networks carry more traffic and are more reliablethan networks using traditional routing protocols. The aforementionedtechnologies are not suitable for neural networks as the networkoptimization is far too slow and imprecise to support a possible neuralnetwork.

What is needed is a technology that provides the quality of engineeredpaths, but at wire speed and on demand for each user.

SUMMARY OF THE INVENTION

A previous application, now U.S. Pat. No. 8,547,981, to which thisapplication is a continuation-in-part, called an SRP network,demonstrated a neural network capable of making complex path selectiondecisions for a packet data network. This application enhances thatsystem to allow it to exhibit more general purpose neural networkfunctionality including the solving of complex mathematical optimizationproblems.

In order to understand the specialized terms used in this application, aglossary is provided.

Glossary

-   ANN—Artificial Neural Network.-   COS—Class of Service.-   Data Neuron—The logical component of a data neural network.-   DNN Data—Neural Network: An artificial neural network that relies on    time delay as weights for its functionality.-   FIFO—First In/First Out memory-   Hunting Packet—A signaling packet used to expose a path right-of-way    between a source and a destination.-   Label—A 20-bit address, unique to each link on each node which is    modified as a packet progresses through the network.-   LSP—Label Switched Path.-   MPLS—Multiprotocol Label Switching.-   OA&M—Operation, Administration and Maintenance.-   PHY—Physical Layer (Serial Port Hardware).-   PK/AV BW—Peak/Average Bandwidth. A 16-bit word to represent peak and    average bandwidth requirements for a LSP.-   Policy—A 16-bit code provided by system managers to limit    transmission of packets on certain links.-   PSN—Packet Serial Number. A 20-bit system wide serial number    temporarily assigned to a hunting packet for unique identification.-   QOS—Quality of Service. A 12-bit code representing priority of    transmission and packet latency.-   RCV/XMT—Receive/Transmit. A 16-bit number to uniquely represent each    node in a Domain.-   Setup Packet—A signaling packet used to establish an LSP across a    path right-of-way.-   SERDES—Serial/Deserializer, Serial to Parallel converter.-   SRP Network—Self-Routed Packet Network: A connection oriented packet    network that functions as a neural network, and is capable of    building paths as needed.-   Tear Down Packet—A signaling packet used to remove an existing path.-   TTL—Time to Live. A 10-bit representation of time left before packet    expires.-   User Packet—Packets that transport user data along an existing LSP.-   Virtual Neuron—A subset of a data neuron. Each data neuron can be    broken up into many virtual neurons.

The Internet, a layer 3 packet network, has been proven to be aneffective method of interconnecting computers. Recently there has beenmuch interest in adapting the Internet to allow it to reliably transportpacket flows such as voice and video. This invention provides a methodto achieve this result.

A layer 4 packet network provides a means for the client computers todirectly control connections and to use those connections to transporttime sensitive packet flows reliably and securely.

The transport aspect of the MPLS architecture (Label Switching) waschosen for the preferred embodiment as it is connection oriented andshown to be reliable. The other aspects of the MPLS architectureincluding routing and programming of the LSP's was determined to beinsecure, too slow, and unreliable, and was replaced by the architecturedisclosed in this patent.

A key portion of a layer 4 network is the routing system. To design asuitable routing system it was necessary to find a system that wouldexpose an optimized path right of way between a source computer (callingparty) and the destination computer (called party) as quickly aspossible. In addition it must use current dynamic network parameters andnot static parameters previously collected and stored.

In addition the routing needed to be an auto-discovery variety allowingthe network itself to take on the routing burden so that little or noprovisioning would be necessary. As previously discussed, carriers hadto resort to engineered networks to achieve the optimized paths neededfor the invention.

If the calling party is the talker and the called party is the listener,a simple broadcast network employing one talker and many listeners forestablishing a connection would be suitable. This type of networkquickly breaks down as the number of talkers increase. One approach isto increase the performance of such a network by using a distributedhardware based design that can run at a high speed as opposed to acentralized software based design found in today's networks. As thehardware approach was simple and inexpensive to implement it was chosenfor the embodiment.

Although the broadcast approach works fine on local area networks(LANs), it breaks down when applied to a mesh network because loops canbe created with resultant network overload. Broadcasting in meshnetworks is sometimes called “flooding.” Techniques such as the spanningtree algorithm can be used to correct this problem but fall short asthey are too slow to adapt to changing network conditions. In additionspanning tree can deactivate links needed for load sharing.

The problem of loops can be eliminated by simply destroying allduplicate broadcast packets, which is sometimes called quenching. Thisembodiment caches and forwards the first instance of each broadcastpacket to arrive at a node, and destroys all future instances. Thesepackets are called hunting packets in the embodiment.

In a mesh network many paths can exist between the calling and calledparties. The shortest path can be called the primary path while theother paths can be considered secondary. The hunting packet previouslydescribed exposes only the primary path as hunting packets traversingthe redundant paths are destroyed.

As networks become larger it is necessary to limit the number of talkersthat can access a listener at any given time. This can be accomplishedby requiring each talker to obtain a token before broadcasting.Broadcast loading is now easily controlled by simply limiting the numberof tokens. This embodiment uses tokens and the token is called a packetserial number (PSN).

In the simple broadcast network previously described the broadcastpackets flow through the mesh network exposing all possible pathsbetween the talker and the listener. This technique is highlyinefficient because usually only a few viable paths exist and should beexplored while exploring the remaining paths is a waste of networkresources.

This embodiment uses a method called bridging to reduce the transmissionof unnecessary hunting packets. When a hunting packet from a first nodelooking for a second node arrives at any given node the identity of thefirst node is cached at the receiving port. Any future hunting packetslooking for the first node, including those from the second node, willonly be forwarded on ports bearing the signature of the first node. Thistechnique along with others known to those of skill in the art limitsthe number of hunting packets to a manageable level.

Although the aforementioned techniques can be used to provide thefundamental structure for the disclosed routing method, they are notsufficient to be acceptable for the disclosed network. When a huntoccurs in the disclosed network for an optimal path several simultaneousconditions must be met. For example, the desired packet flow will needto be a certain bandwidth, its latency must be less than a certainlimit, and it must meet certain policy and QOS constraints. Thetransmitted hunting packet will contain a binary representation of eachof the required metrics. Each node will check each constraint and onlyforward hunting packets that will meet every specified condition.

Special hardware is disclosed in the embodiment that allows the checkingto be done in a pipelined fashion so that no appreciable delay isincurred as the hunting packet passes through each node.

Consequently, the only appreciable delay a hunting packet may incur isthe propagation delay between nodes, or perhaps intentional delaysinserted as part of policy constraints. In this manner a hunting packetwill traverse the same path right of way that a user packet wouldtraverse (assuming the perspective route was chosen). Because the delaysencountered by the hunting packet match the delays that would beencountered for the final packet flow, a true and accurate model hasbeen made at each path selection. The hunting packet arriving at thecalled party first has, by definition, taken the most optimum path atthat instant in time. Since in most cases no appreciable delay will haveoccurred other than the propagation delay, the path selection is said tohave been at wire speed. As the packet metrics are taken into account oneach link traversed, the final choices can support very complex routesthat would be virtually impossible to model offline. As each routingdecision is made using real constraints and under real field conditions,the network will be self correcting and self optimizing. Externalpolicies can be used to “teach” the network certain preferred routes.This teaching is accomplished by adding delay to less desirable routesthereby encouraging the selection of a more desirable route. Thisability to teach the network is an indication that this network is aneural network.

Once the hunt for the optimal path right of way has finished, it is nowtime to build the actual path between the calling and called parties.For a layer 4 packet network to be viable it is necessary for noappreciable delay to occur in the path setup process. For each node inthis embodiment the first arrival of a hunting packet at a given port iscached at that port. In addition the ports that forwarded said huntingpacket also cached a link between the arrival port and departure port. Aspecial packet called a setup packet follows the links back to thecalling party programming the label switched path (LSP) at each nodetraversed. When the setup packet arrives at the calling party, it passesthe label for the required path. As this process also operates at wirespeed, a layer 4 connection has been made between the calling and calledparties as fast, or even faster than any possible layer 3 network couldhave performed the task. Because this programming task only involves thenodes and links used for the connection, this process fundamentallysecure and can be called “distributed control”.

The architecture disclosed in this embodiment uses special hardware andis memory intensive. For these reasons this approach would not have beenviable when the Internet was developed.

This system and method allows each user to make a connection on demandin real time, as opposed to the existing MPLS layer 2 technology thatrequires a third party to make connections for groups of users off line.

The MPLS networking architecture in use today is insecure as it dependson an IP routing platform to perform the routing and network managementfunctions. The network technology disclosed in this embodiment not onlysupports the label translation aspects of MPLS, but contains additionalspecialized packets that support additional network functions such aspath exposure or identification, path setup, path tear down, and OA&Mfunctionality.

The previously described technology is ideal for ANNs, as the creationand destruction of paths is under the control of the network. As seenfrom the references, for a network to be a neural network, it must useweights to affect the output of each neuron. The network disclosed inthis application also uses weights at each node to aid in theestablishment of each LSP. The details of these weights are discussed inthe “Description of the Preferred Embodiment”.

In order to understand the operation of a data neural network (DNN) asdescribed in this application, it is necessary to review the conceptstaught by McCulloch and Pitts as seen on page 34 of Reference 1, andFIG. 29: “This mathematical neuron computes a weighted sum of n inputsignals x_(j), j=1, 2 . . . n and generates an output of “1” if this sumis above a certain threshold “u”. Mathematically,

$y = {\theta( {{\sum\limits_{j = 1}^{n}{w_{j}x_{j}}} - u} )}$

Where θ (⋅) is a unit step function at “0”, and w_(j) is the Synapseweight associated with the j^(th) input.”

In adapting this model to the data network of this application, thevariable x_(j) is associated with the j^(th) LSP, and the variable w_(j)is associated with the time delay incurred by a packet traveling alongthe LSP.

The threshold value “u” corresponds to the time-to-live (TTL). Setting

$u = \frac{1}{TTL}$as TTL sets a limit for maximum latency.

For this network,

$w = \frac{1}{T}$

This delay T=T_(P)+T_(Q)+T_(L)+T_(W)

Where

-   -   T_(P)=Propagation delay of the logic.    -   T_(Q)=Queuing delay from congestion    -   T_(L)=Latency of the link between the nodes    -   T_(W)=Additional delay added to influence path selection

$T = {\sum\limits_{j = 1}^{n}t_{j}}$and t_(j) is the delay of each hop.

-   -   Where n is the total number of hops traversed by the LSP.

The behavior of a DNN can be easily verified against the expressionsabove, as the best network choice will have the least latency T_(L), andwill have the largest weight. In other words, the longer the delay, thelower the weight. Also, delays longer than TTL yield a weight of zero.

The delay T is a sum of several components. Each component contributesto the total delay, so must be taken into account. T_(W) is actually thesum of two delays: T_(Wn)+T_(WV). T_(Wn) is used to normalize, orcorrect for imbalances in the network to allow it to yield accurateresults. T_(WV) is the time delay variable that describes therelationship between the objects in the problem. Another way to providemore control of connections with T_(W) is to make T≃T_(W). This can bedone by making T_(W)>>T_(P)+T_(Q)+T_(L).

For a data network to be upgraded to a neural network of thisapplication, ones of skill in the art will need a reliable and securenetwork where each path is deterministic and can be guaranteed. Theywill also want a reliable network where usage can approach 100% withoutany degradation of the network. They will also want a network needinglittle provisioning and traffic engineering. This architecture meets allthese requests. Some of the features of this architecture are asfollows:

-   -   1) Automatic setup and teardown of LSPs at wire speed.    -   2) Built-in support of policy and QOS including latency.    -   3) Strict admittance controls to limit congestion.    -   4) OA&M built into architecture.    -   5) No upper limit on complexity or size.    -   6) Automatic rerouting around failed nodes or links.    -   7) Automatic building of completely independent redundant paths.    -   8) Low cost, highly reliable hardware platform.    -   9) Support of Layer 2 services including TDM voice.    -   10) Provisioning used to enhance network performance, but not        required for basic setup.    -   11) Full multicasting support.    -   12) Adjustable delays associated with each LSP to tune network        functionality.    -   13) A fundamentally secure network where information only passes        between the sender and the receiver.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates the overall system block diagram of an example Layer4 self-routed packet (SRP) network which functions as a Data NeuralNetwork (DNN).

FIG. 2 illustrates a physical design of a representative Switch FabricNode of the SRP network, which is also a Data Neuron in a neuralnetwork.

FIG. 3 is an SRP network schematic diagram used to illustrate theprogression of a connection through the network from a calling partyedge node to a called party edge node.

FIG. 4 shows how packet timing information used in establishingconnections is transported throughout the network.

FIG. 5 is a timeline showing how packet timing information relates tosegment boundaries.

FIG. 6 is a system block diagram of a 16-port Switch Fabric Node.

FIG. 7 is a block diagram of the Receive Module of FIG. 6.

FIG. 8 is a block diagram of the Transmit Module of FIG. 6.

FIG. 9 is a flowchart showing how a User Packet progresses through theReceive Module (FIG. 7).

FIG. 10 is a flowchart showing how a User Packet progresses through theTransmit Module (FIG. 8).

FIG. 11 is a flowchart of a Hunting Packet progressing through theReceive Module (FIG. 7).

FIG. 12 is a flowchart of a Hunting Packet progressing through theTransmit Module (FIG. 8).

FIG. 13 is a flowchart of a Setup Packet progressing through the ReceiveModule (FIG. 7).

FIG. 14 is a flowchart of a Setup Packet progressing through theTransmit Module (FIG. 8).

FIG. 15 is a flowchart of a Teardown Packet progressing through theReceive Module (FIG. 7).

FIG. 16 is a flowchart of a Teardown Packet progressing through theTransmit Module (FIG. 8).

FIG. 17 is a simplified flowchart of a User Packet progressing through anode including the label translation.

FIG. 18 is a simplified flowchart of a Hunting Packet progressingthrough a node including PSN checking.

FIG. 19 is a simplified flowchart of a Setup Packet progressing througha node including the programming of the label translation table.

FIG. 20 is a drawing illustrating the data structure of the 64 bits inthe User Packet address.

FIG. 21 is a drawing illustrating the data structure of the 5 levels of64 bits illustrating the Hunting Packet.

FIG. 22 is a drawing illustrating the data structure of the 2 levels of64 bits illustrating the Setup Packet.

FIG. 23 is a drawing illustrating the data structure of the 64 bits inthe Teardown Packet address.

FIG. 24 is a drawing illustrating the data structure of the labeltranslation table in the forward direction.

FIG. 25 is a drawing illustrating the data structure of the PacketSerial Number (PSN) Reference Table.

FIG. 26 is a drawing illustrating the data structure of the LabelTranslation Table in the reverse direction.

FIG. 27 is a drawing illustrating the data structure of the BranchTable.

FIG. 28 is a drawing illustrating the data structure of the Output PortFlag Table.

FIG. 29 is a drawing of the McCulloch-Pitts model of a neuron and thecorresponding mathematical expression.

FIG. 30 is a schematic of data neurons implemented using SRP RCV 62, andSRP XMT 63, which are part of switch fabric node of FIG. 6.

FIG. 31 is a data neuron array co-located on a PCB or semiconductorsubstrate.

FIG. 32 illustrates the relationship between data neurons and virtualneurons.

DESCRIPTION OF THE PREFERRED EMBODIMENT Physical Architecture

This section describes the physical architecture of a model systemdesign of an MPLS type network using the SRP Networking methods.

A domain is a collection of nodes that are managed by the same entity orare in a specific geographic area. FIG. 1 shows a typical SRP NetworkDomain. A domain 16 consists of Edge Nodes 11, Junctors 15, SwitchFabric Nodes 14, OA&M consoles 13 and Links that interconnect the nodes.

Edge nodes 11 provide entrance and exit ports for a SRP Networks Domain.Edge Nodes 11 translate between the layer 4 SRP Networks Architectureand other networking architectures such as MPLS, ATM, Frame Relay,SONET, TCP-IP, TDM, etc. Edge Nodes 11 use Hunting Packets to buildLabel Switch Paths (LSPs) to other Edge Nodes subject to QOSrequirements such as latency and guaranteed bandwidth, and subject topolicy constraints such as access restrictions, use of specific serviceproviders, link cost or types of links. An Edge node can be aspecialized piece of hardware such as an intelligent channel bank ormultiplexor with a processor to establish or manage the layer 2 path toa similar node at the other side of the network. The edge node can alsobe a PC executing a special layer 4 protocol stack that manages theconnection directly, or operates the network as a DNN.

Junctors 15 are special edge nodes used to link between SRP networkdomains. They provide a logical connection point where Hunting Packetsare terminated. The SRP network methods allow hunts to traverse multipledomains as part of a path hunting phase. When DNNs are part of aphysical device, such as in robotics, the Junctors provide a logicalconnection point for the devices.

Switch Fabric Nodes 14 (Data Neurons) form the heart of a SRP networksdomain 16. They form a mesh network interconnecting each other and edgenodes to form a data neural network (DNN). Switch Fabric Nodes 14contain little intelligence and only store enough routing data to move apacket to the next node or to make simple changes to the packet. Arraysof these nodes may contain special sensors or computational abilities toallow them to serve as data neurons in complex DNNs.

OA&M consoles or Administrative Terminals 13 are computers runningadministration software used to teach the network. These terminalsappear as edge nodes to the Domain 16. These terminals collect OA&M datafrom each node in the Domain 16. The OA&M data consists of node and linkstatus, traffic data, congestion, latency information, link failures,etc. The data can be displayed in map form on the console with new nodesand links automatically appearing. The consoles operate automatically,and optionally provide a means for system administrators or networkengineers to enter policy information to be sent to all the nodes in theDomain. The consoles can also be used to model the network and testperspective policies. In effect, the consoles provide a means to teachthe neural network the functionality it needs to perform efficiently.

A link can be any transport medium including fiber, wire, or radio. Thelinks can be any speed including 10G Ethernet. All links arebidirectional and are in service only if both directions areoperational. In the case of radio or optical, the links can be point tomultipoint where the established link is dependent on location of radioor optical receivers. Under certain circumstances the reverse directionmay need to be set up independently.

FIG. 2 shows a drawing of a typical SRP Networks Node. This nodecontains 16 10 GE ports and is One R.M.S. high. The node would be NEBSLevel 3 compliant and operate on −48 Volts DC. The node would contain anSD RAM flash memory 17 containing security keys and policy information.The node would have a tri-color LED associated with each port. The LEDwould allow service personnel to see at a glance the status of thelinks.

Today's data networks use OSI Layers to isolate higher and lower datafunctions. The higher layers depend on the proper operation of the lowerlayers to ensure proper system operation. This section will discuss theoperation of the SRP Network by layer:

The lowest layer is the physical layer. SRP Networks supports mostpopular physical links such as Ethernet, T1, or SONET.

Each link uses “PHY” chips to support framing and link signalling. Themessages between these chips and SRP are used as part of Layer 2conductivity.

Layer 2 messages are used for 2 nodes connected by a link tocommunicate. Message types used by SRP Networks follow:

SRP Networks can be used in a completely open environment, or it can bemade secure through the use of encryption.

Node Synchronization

When a new node is connected to the network, Layer 2 messages areexchanged to ensure the node is part of the network. Static keys areexchanged, and a node number is assigned to the new node to become partof the network. Once this process in completed, the synchronizationprocess can start.

In order for a SRP Network Domain to measure delay between nodes and toproperly time stamp packets, each node must be synchronized in time.This synchronization is done through the exchange of timing messagesbetween nodes. This synchronization requirement may be relaxed if eachnode contains an accurate (GPS type) internal clock.

First, the clock on the new node must be synchronized with the rest ofthe system. The node contains a phase locked loop that is synchronizedto the other nodes in the system through the transmission of timingmessages. Network synchronization is usually accomplished through theuse of an external reference (usually a GPS source) and by having nodessynchronize off that source. Many synchronization schemes are known tothose of skill in the art and will work in this system. Also, if thenodes are co-located, synchronization can be as easy as using a commonclock and frame.

Once a new node is synchronized to the network, link delay must bemeasured. This is accomplished through the exchange of timing messages.It should be understood that when a node is not stationary, thesynchronization process is more complex as offsets are needed to correctfor the motion.

When the synchronization process is complete, the node is said to be“locked.” Locked nodes all share a precise time reference. For securesystems the time reference can be used as one of the keys. Systemslocked together like this can provide for very accurate time stamping ofpackets and very accurate measurement of latency across the network.This synchronization also allows SONET and other layer 2 synchronousservices to work correctly through the network.

The communication of link status between nodes is essential to ensurethat the link is functioning properly. For example, link error rate mayneed to be checked. If the error rate degrades to the point that linkreliability is threatened, the link will need to be taken out ofservice. When the link is removed from service the network can re-switchpacket flows to the other working links. Co-located networks used formath problem solving do not need the above functionality as the nodesand links are under a central control and not subject to the issuesdiscussed above.

Layer 3 signalling packets are those used to set up an LSP, manage anexisting LSP and packets used to manage the transportation of a payloadthrough an LSP. Examples are Hunting Packets, Path Setup and PathTeardown packets, OA&M packets between nodes, and payload managementpackets.

Layer 4 operations occur at the interface point between the edge nodesand the users. It is for this reason this network can be called a layer4 network. This is the point where packet data is converted to SRP MPLS.Management of the LSP occurs at Layer 4. The checking of latency andpacket loss and the building of replacement LSPs are all Layer 4functions.

Application Layer operations can occur once the network is set up. Thenetwork can support transport of user packets, or it can act as aplatform for solving higher level problems.

System Operation

This section deals with the basic operation relating to the setup andmanagement of LSPs. LSP operation can be divided in four phases. Theseare as follows:

1) Path Hunting

2) Path Setup

3) Path Usage

4) Path Teardown

System operation is described in relation to the SRP methods; however,these phases can exist in all networking technologies. The operationdescribed can be applied to all packet technologies including IPnetworking.

The hunting phase is entered as soon as a path is needed to carrypackets between the calling and the called parties. FIG. 3 shows atypical network consisting of nodes and links. When calling party 01needs to build a path to called party 02, party 01 would transmit ahunting packet. A hunting packet is a signalling packet used to build apath right-of-way between two or more edge nodes. In the example, edgenodes are 01 and 02. FIG. 21 shows the data structure for a huntingpacket.

Hunting packets flood the network subject to policy and congestionconstraints. When a node receives a hunting packet it will retransmitthat packet on each link leaving the node except the arriving link,subject to policy constraints. In the example on FIG. 3 calling party 01would transmit a hunting packet on link 10 arriving at node 20. As canbe seen by one of skill in the art, a method of limiting transmission ofhunting packets is needed to prevent broadcast storms. The limitingoccurs by providing each hunting packet with a unique bit pattern calleda packet serial numbers (PSN). This PSN, along with a time stamp, isused to identify duplicate hunting packets. All duplicate packets aredestroyed. FIG. 25 shows a PSN reference table. In the example, node 31would receive hunting packets from nodes 20, 21 and 32. Only the firstarriving hunting packet would be retransmitted (probably the onearriving on link 22). The retransmitted hunting packet would arrive atthe calling party 02 on link 34. The path traversing links 10, 22 and 34is called a path right-of-way.

Many factors can influence the outcome of the hunt: Policy constraintscan delay or block the progression of hunting packets through certainlinks. Congestion can delay the packet's progress through certain linksallowing the optimum path to be chosen through other non-congestedlinks. Each hunting packet carries a time stamp. This time, coupled withQOS data, defines the maximum time allowed for the packet to exist. Thistime signals the close of the hunt and all the hunting packets carryingthat time stamp are destroyed.

Each node logs the first reception of a hunting packet. The arrival timealong with the port receiving the packet is logged opposite the PSN.This information is used later during the path setup phase.

When the called party 02 receives the hunting packet from the callingparty 01, the called party will set up a path from 01 to 02. To buildthe path the called party will transmit a setup packet on link 34 tonode 31. A setup packet is a special signalling packet similar to ahunting packet. FIG. 22 shows a setup packet data structure. A setuppacket contains a special address that tells each node to perform thelogic functions that are about to be described. The setup packet sent bythe called party will contain a label selected by the called party toidentify the connection. It will also include policy and QOS data, andthe PSN and time from the hunting packet previously received. When node31 receives the setup packet it looks up the PSN and checks the otherdata to ensure the setup packet matches the previously stored huntingpacket. The stored data includes a reference to the port that receivedthe hunting packet.

In the example in FIG. 3 each node contains a port that is associatedwith a link connected to another node. Each port contains a processingsystem including a translation table. This translation table (FIG. 24)is a memory where the address corresponds to a label, and the datacontains another label along with port number, QOS and time data. Thistranslation table is read and written each time a user packet traversesthe node. When the setup packet arrives at node 31 on link 34, it isvalidated and forwarded to the port corresponding to link 22.

The processor associated with the port for link 22 selects a label froma table of available labels, and programs the translation table at theselected label's address with the label from called party 02, along withQOS, time data, and the address of the port receiving the setup packet(link 34).

After programming the translation table the processor replaces theoriginal label in the setup packet provided by called party 02 with thelabel it just selected and transmits the packet on link 22.

When the setup packet arrives at node 20, the procedure just describedis again performed, and the packet is forwarded to the calling party 01on link 10. When calling party 01 receives the setup packet containingthe label from Node 20, it has been given the label for a new LSP fromthe calling party 01 to the called party 02.

As seen from this example, the path setup process can occur at wirespeed when suitable processors are selected. Also, the process isindependent of the number of nodes involved, functioning in the samemanner for large networks with many nodes as the example just discussed.

For systems involving a static address, such as IP networks, an IPaddress can be provided by called party 02 in response to a request byparty 01, or the address can be provided by party 01 and acknowledged byparty 02. Instead of a label provided by party 02, the setup packet forparty 02 would contain the IP address. That same address would beprogrammed into the translation table (or packet forwarding table) ofeach of the intermediate nodes all the way back to party 01 aspreviously described.

In the example when called party 02 provides the label to calling party01, the LSP is said to be “cut through.” Once the path is cut through,node 01 can start a packet flow to Node 02.

When Node 20 receives a packet from calling party 01 it looks up thelabel which produces the address of the port for link 22 along with thenew label. It checks the time stamp to see the packet is current andreplaces the label and forwards it to link 22. This method is repeateduntil the packet arrives at the called party 02.

A path teardown will occur when the user has finished transmission andno longer needs the path. Path teardown can also occur in the event of afailure of the link. A signalling packet called a teardown packet (FIG.23) performs the procedure. The packet can be generated by the edge nodeas part of a Layer 4 function, or it can be generated when a nodedetects a path failure. When a failure occurs, the node sends a teardownpacket on each LSP associated with the failure. A teardown packet looksand acts like a user packet, and it traverses an LSP in the same manner.

In the previously discussed example of an LSP between Node 01 and Node02, assume a failure of path 22. The port for path 22 triggers Node 31to initiate a teardown packet. Node 31 sends teardown packets on allLSPs including the LSP traversing link 34. When the processor associatedwith the port connected to link 34 reads the packet, it clears the entryin the translation table associated with the LSP. It then transmits thepacket over link 34 to called party node 02. At this point, a layer 4process can re-establish the connection.

Teardown packets are also employed when a problem exists in the setupprocess.

In the previous discussion of a path setup between Node 01 and Node 02,assume a failure of link 22 occurred just after the hunting packetexposed a path right-of-way. When the setup packet reaches Node 31 viapath 34, Node 31 attempts to build a path onto link 22 and discovers thefailure. The failure triggers the initiation of the teardown packet atNode 31. The teardown packet propagates back up the partially completedLSP to the called party Node 02. Layer 4 functions cause thetransmission of a new hunting packet from Node 01. The hunting packetexposes a new right-of-way not using link 22 and the LSP is set up.

System Features

As has been shown in this document, the selection of an LSP is acombination of many variables:

Satisfaction of policy constraints; plus

The propagation delay of each hop; plus,

The queuing delay of each node, which is dependent on COS; plus,

Weightings for the cost of each path; plus,

The functions of paths out of service or have become too severelycongested to be available.

In addition to above, the path choice is dependent on choices made forother paths taken by users that have a higher priority or class orservice (COS) than the user in question.

Once the path is chosen, the quality of that path can degrade over timeas other higher priority users consume more resources for their paths.As a path becomes more congested, its latency increases. By monitoringthis latency, it is possible to determine when the latency has exceededa predetermined threshold, and to initiate a hunt for a new path.Assuming the hunt yields a new path, the LSP for the packet flow isreplaced by the one for the new faster path. Once the old path is nolonger needed, it is torn down.

This process of building new LSPs to control latency is called LSPchurn. LSP churn is a by-product of a self-routing system such as thisone, and needs to be controlled to maintain network stability. A networkof this type will need to continually adjust itself to maintainstability.

Several methods can be used to control LSP churn: The simplest method isto provide adequate links and nodes to support network traffic. Thehunting algorithm will evenly load multiple links. This load balancingcapability will allow additional links and nodes to be turned up inparallel with existing ones to spread the load and relieve congestion.

Another method of control is through policy restrictions. Each huntingpacket carries a policy profile. This policy profile is indexed into themaster policy map of each node. Through the use of this policy profilethe network is fundamentally secure and the system manager has completecontrol of each packet flow and can limit certain packet flows tospecified paths. With this technique, packet flows with high prioritycan traverse links previously made off limits to lower priority packets,ensuring bandwidth and latency requirements are met.

Another method of control is through the use of QOS and bandwidthcontrols. Each hunting packet includes a specification of QOS andbandwidth. These QOS and bandwidth parameters are assigned at Layer 4and are encoded into the hunting packet. QOS is controlled by assigninga separate class of service to each packet flow. Packets are queuedbased on COS. This system uses a technique called hard QOS; all packetsin a higher priority queue must be exhausted before lower queues areallowed to empty. Hunting packets are forced to wait in the same queuesas user packets of the same COS. In this manner, the LSP right-of-wayexposed by hunting packets matches the conditions that will be seen bythe potential new packet flow, and choice of the route for this newpacket flow is made based on real network variables.

Each port on a node keeps a tally of the available bandwidth on itslink. This bandwidth is stored based on QOS. A packet flow with a higherclass of service (COS) has access to all the bandwidth except for whatwas taken by higher-class flows. Each time an LSP is assigned, theavailable bandwidth requirements are checked before a hunting packet isallowed to traverse a link. In this manner, only suitable links areincluded in each hunt.

When the hunt is finished and the called party node accepts theconnection request, it transmits a setup packet. This packet traversesthe right-of-way exposed by the hunting packet. When the setup packetprograms an LSP into a node, the available bandwidth for that COS forthe link containing the LSP is reduced by the amount to be used. If theavailable bandwidth is used up on a given link before all setup packetshave passed through the link, the link will be blocked for the remainingsetup packets. When the new LSPs do not appear in time, Layer 4functions will re-issue the hunting packets which will build newright-of-ways that do not include the previously mentioned link.

When there are too many users and too few links on a congested network,other methods can be used to load additional users on a congestednetwork. A scheme called COS forward biasing can be used to fit a fewmore users onto a network by elevating the COS of the new users by onelevel. This can displace existing users which in turn will find newroutes. Tests like this should be done only under controlled conditionsor modeled at OA&M consoles to insure no service outages occur.

Another bias technique is called reverse bias. Reverse bias sets thehunting packet COS one level lower than the COS for the LSP. The resultis that the hunting packets do not compete with the packet flowscarrying that COS. This bias scheme causes the minimum amount ofdisruption to the network as ample bandwidth must be available for alink to be chosen for the LSP.

For large networks, servers would be used to control the use of huntingpackets. A user would request a path through a server which would havealready secured paths to common destinations. The servers could act asgate keepers by limiting requests to unauthorized locations. Users couldsubscribe to servers in a similar way as subscribing to telephoneservice.

To ensure viability and security of a SRP Networks domain, it isrequired that the user and control planes remain separate. Thesignalling packets discussed in this document must not be accessible tousers. This isolation is provided by the edge nodes. The signallingpackets are for the exclusive use of the system administrators and thesystem itself. Various checks can be performed in the signallingfunctions to ensure system integrity. Signalling packets appearing thatare not part of a previously described process must be alarmedimmediately. Additional measures can be provided when portions of thenetwork are exposed to outside forces. The previously discussed policymap included on each hunting packet can be expanded and encryptedensuring hunting packets produced by outside forces only go to anauthorization center. The center can validate the user and supplyadditional keys to allow the user to only hunt nodes that are cleared.

Admission to the network is only provided through the generation andsubsequent acceptance of a hunting packet. Improperly generated huntingpackets are ignored and alarmed.

Hunting packets employ a Packet Serial Number (PSN). This serial numberis unique to each hunt. Each node is assigned a block of one or morePSNs depending on its traffic. The PSN is coupled to a time stamp touniquely identify each packet on the hunt. A PSN assigned to a huntcannot be used again until the first hunt is finished. As each node hasa limited number of PSNs, it is limited in the amount of simultaneoushunts it can perform. As there are a limited number of bits in the PSNfield for hunting packets, there are a limited number of simultaneoushunts that can take place at any given time. As the hunting packet PSNspace is spread out over the entire domain, the number of simultaneoushunts is further limited. As hunting packets only traverse availablenodes and links, the presence of hunting packets does not impair networkperformance. Also, the node hardware design allows hunting packets to beprocessed at wire speed. This combined with the fact that the length ofhunting packets is extremely short further minimizes the impact of thesepackets.

The packet waiting system is used to provide weights or delays oncertain packets such as hunting packets as they propagate through thenetwork. These weights slow the propagation of certain packets as theytraverse the system allowing packets on less desirable routes to catchup. In a sense, these packets “level” the playing field. Packet waitingis implemented through the policy system allowing system administratorsor system software to tailor routing decisions to match real worldconstraints. Delays can be assigned to hunting packets traveling on veryfast, but expensive routes to bias choices toward less expensive routes,but allow the use of the more expensive routes as the cheap routes fillup. In this manner, complex routing decisions can be made based onactual network conditions in real time, thereby avoiding slow,expensive, complex and often inaccurate off-line modeling. In mostcases, packet waiting variables are static and can be added to policyprofiles and automatically downloaded to nodes from the OA&M consoles.

Through packet waiting, neural network functionality is exhibited, asextremely complex routing decisions involving choices between routes ofdifferent costs, times of day, capacities, traversing long distances,changing paths and carrier requirements can be made almost instantly.Packet waiting is fundamentally secure as it is physically impossible toreverse time.

By providing each port on each node a shift register delay line, orequivalent software implementation, the system can be easily made tosupport packet waiting. The policy bits on the hunting packet can beindexed into the policy table for that port to obtain a value to programfor the delay. The hunting packet is then forced to wait that amount oftime before it can move to the next node. As the delay is provided on a“per node” and “per policy”, and “per QOS” basis, complete control isprovided on the routing of each packet flow.

In addition to the policy related routing decisions previouslydiscussed, there are several other benefits of packet waiting: Forexample, if one wanted to build a redundant path, one that did nottraverse the same nodes or links as the original path, packet waitingcould be used. By assigning delays (weights) to the original path, andthen transmitting a hunting packet, the newly exposed right-of-way willavoid, as much as possible, the original path. Packet waiting is aplatform used to support several complex features that will be discussedlater. The weights give the network intelligence necessary to performthe complex routing and to act as a platform to solve complex mathproblems.

Under certain conditions it is possible to build a first and second pathfor packet flows between an originating and a terminating node. Thesecond path can have as few as possible shared links or nodes with thefirst path providing an extremely reliable packet flow. The redundantpath carries the same packet flow as the original path except that it isdelayed by AT. The additional delay AT is the difference between thefirst choice path and the second choice path. Arriving data on the twopaths can be compared and a decision can be made as to which packet flowwill be forwarded to a receiver.

Multicasting has become very important as a means to transmit high-speedvideo or other information. The support of multicasting on previous MPLSsystems has been problematical, as it requires the processing of largeamounts of path data.

Multicasting is automatic in the SRP Networks Technology, as each nodemust replicate hunting packets as part of exposing a path right-of-way.

This replication or “branching” occurs automatically as part of eachhunt. The right-of-way exposed with a hunt can be seen as a tree withthe trunk at the source node and the branches extending out to thedestination nodes.

FIG. 3 shows a model network with calling party 01 and called parties 02and 03. From the previous discussion a hunting packet exposed a pathright-of-way from node 01 to node 02 via nodes 20 and 31.

If needed, the same hunting packet could have exposed a pathright-of-way through Nodes 20, 21 and 32 to Node 03. In this example, ahunting packet leaving Node 01 would arrive at Node 20 through link 10.Node 20 would transmit the hunting packet on links 11 and 22 to Nodes 21and 31. The same hunting packet would then be transmitted to Node 02 vialink 34. Another instance of this packet would be transmitted to Node 32via links 33 and 24. Node 32 would transmit the hunting packet to Node03. If both Nodes 02 and 03 were programmed to respond to the samepacket ID, a branched connection could be established.

In the example system, Node 32 received 2 hunting packets: one on link24 and one on link 33. Assuming the first packet to arrive was on link24, the node would assign that link as the trunk of its tree, and wouldignore the packet arriving on link 33.

As previously discussed, Node 02 would build a path right-of-way back toNode 01 via Nodes 31 and 20. If branching was enabled, Node 03 couldalso build a path to Node 01 through Nodes 32, 21, and 20. In thisexample, Node 20 becomes the branch point. If conditions were different,Node 31, or even Node 32 could just as easily been the branch point.

The propagation of a setup packet from Node 02 to Node 01 for thepurpose of building an LSP was discussed previously. In the same manner,a setup packet would go from Node 03 back to Node 01 via Nodes 32, 21and 20.

Assuming the LSP from Node 01 to Node 02 was set up first, the setuppacket from Node 03 would arrive at Node 20 on link 11. Note that bothsetup packets contain the same PSN and time stamp as they were derivedfrom the same hunting packet. If branching is allowed, Node 20 wouldforward both packets back to Node 01 via link 10.

As Node 20 became the branch point, it would forward all user packetsbearing the LSP it had previously assigned on both links 11 and 22.

It should be noted that the label translation table at Node 20 for thispacket flow would show 2 ports for links 11 and 22 along with a separatenew label for each link.

It should be also noted that the first setup packet to reach the sharedportion of the LSP e.g.: the trunk of the tree would actively programthe LSP back to the source node. Each additional setup packet wouldmerely follow the path back to the source node. The calling party node01 would receive setup packets each providing the same label but showingdifferent called party nodes. In this manner, the calling party nodealways knows all the called nodes receiving the packet flow.

LSP conditioning is the binding of an LSP to a PSN. When LSPs are firstsetup they are bound to a PSN, but the binding disappears when the PSNis reused on another hunting packet. The PSN supplies a system-wideidentification for an LSP, making it possible to use the LSP for otherprocedures.

Typical procedures include: the addition of a redundant LSP, adding morereceiving nodes to a multicast LSP, merging additional transmittingnodes to an existing LSP.

A conditioning packet is transmitted into an LSP by the source node forthat LSP. The packet travels through the LSP programming a PSN and atime code to each node along the path. Once conditioned, special huntingpackets can be transmitted to implement the desired function.

Conditioning is also used when a network is used as a DNN for solvingcomplex problems. Through the use of policy limitations and conditioningpackets, hunts can be limited to pre-defined LSPs and nodes. In thismanner, hunts can only occur on links with pre-defined delays betweennodes that are part of a DNN solving complex problems such as thetraveling salesman problem.

LSP merging occurs when multiple nodes wish to transmit packet flowsthat merge into an existing LSP. SRP networks can support merging in thefollowing way: A special conditioning packet is transmitted along theexisting LSP. The conditioning packet programs each node to respond to aunique bit pattern. A hunting packet containing a special bit pattern isthen transmitted from the joining node. The first node to receive thepattern will respond with a setup packet. When the setup packet arrivesback at the joining node with the new LSP, the merge is completed.Additional setup packets will be rejected by the joining node.

Another method of merging involves the use of the packet waitingfunction. By forcing all nodes not carrying the existing LSP to delaypropagation of the hunting packet, the new packet right-of-way willfollow the existing LSP back to the receiving node providing a duplicatepath to the existing LSP. The duplicate path is then merged with theexisting path at the merge point.

An alternative to using the conditioning packet is using the label stackapproach found in MPLS. Labels can be nested so that a hunting packet iscarried as a user packet to the point where the hunt must start. Thestack is popped and the hunting packet goes to work. This method can beused in mixed networks where part is SRP, and part is standard MPLS.

As can be seen from previous discussions, LSPs are programmed from thereceiving node back to the transmitting node with the aid of the huntingpacket PSN. Once the path setup is complete, the PSN is no longer usedand the path becomes one-way. One-way paths have a problem that there isno direct way for a path failure to be reported back to the transmittingnode. System performance can be greatly improved through abi-directional path to carry signalling packets back to the source. Apath failure signal can cause the transmitting node to issue a newhunting packet, and build a replacement LSP with little data loss.

Bi-directional LSPs require each port processor on each node to have asecond label translation table. The first translation table converts theprevious label to the next label of the path. The second translationtable is simply the inverse of the first with the address consisting ofthe next label and the data consisting of the previous label. The secondtable would be programmed along with the first, with the data portion ofthe first for the address of the second, and the address portion of thefirst being the data portion of the second.

In addition to the label translation aspect, the table must include theaddress of the outgoing port. In a similar manner the second translationtable will include the address of the incoming port.

It should be noted that the network is not optimized for packets flowingin the reverse direction, so congestion in this direction may beencountered. The congestion problem is reduced by making thesesignalling packets carry a high QOS to provide them priority over otherpackets flowing in the same direction. As packet flows in the reversedirection should be extremely small, little effect on user packetlatency should be noticed.

When a node experiences a link failure, the affected port transmits ateardown packet. With bi-directional LSPs the teardown packet would betransmitted on the reverse path back to the source of the packet flow,along with being transmitted to the destination of the packet flow. Theteardown packet would now completely remove the LSP in both directionsback to both the source and the destination. The teardown packet wouldalso reduce the bandwidth logged by each port along the path.

SRP networks provide several methods of limiting the flow of huntingpackets and possible resultant congestion. One method that can be usedto control hunting packets is bridging. The use of bridging is mosteffective when a portion of the network is connected by a limited numberof links to the main part of the network. Under these conditions thelinks could have a larger than usual percentage of hunting packets. Ifthe links are of low bandwidth the hunting packets could affect usertraffic.

Hunting packets can be controlled through the use of policyrestrictions, but this method requires some effort on the part of systemadministrators. Another method is through bridging. Bridging requires anadditional memory associated with each link. When nodes on one side ofthe links send out hunting packets, the address of the source node isstored in the memory. When hunting packets arrive for that node, thebridging node forwards the hunting packets to the addressed node.Packets addressed to nodes not available through the links do not getforwarded. Because the method discussed is extremely simple, it can bemade to operate in real time. Many other bridging techniques are knownto those of skill in the art. Some of these methods can get quitecomplex and should be avoided, as the processing of hunting packets mustbe kept simple for proper operation.

It is important not to overuse bridging as its use can eliminateotherwise available path right-of-ways that can be useful during timesof congestion.

Another application of bridging is the support of feeder nodes carryingoutlying traffic to the main part of the network. As these outlyingnodes generate hunting packets they are visible to the nodesinterconnecting them to the main part of the network. Theseinterconnecting nodes can use this information to filter hunting packetsnot intended for these outlying nodes. This greatly reduces huntingtraffic going to the outlying nodes. Other schemes can invoke bridgingonly during peak busy hours to help reduce hunting packets at times ofcongestion. By the careful combining of bridging with policy constraintsit is possible to reduce extra hunting packets yet keep the networkoperating at peak efficiency.

Packet segmentation is an optional service that can be invoked on someslower links to prevent long packets with a low COS from affecting thelatency of packets with a higher COS. If a higher COS packet becomesready to transmit while a node is transmitting a long, low COS packet,it can break or segment the low COS packet, transmit the high COSpacket, and continue the low COS packet. The node simply sets thecontinuation bit at the end of a packet, and replicates the label fromthe original packet onto the continued packet. Layer 4 services at thereceiving edge node buffers the first segment until the second segmentarrives, reassembles the packet and forwards it to its finaldestination.

As has been mentioned in previously, all packets are time stamped. Thetime stamp field on each packet is considerably smaller than the storedtime field at each node. In the case of the system disclosed in thisdocument, the overall time field is a total of 64 bits long as itincludes both time and date. Only 10 of the 64 bits are stamped ontoeach packet. FIG. 4 shows a representation of the segment in relation tothe full 64-bit clock.

As the 10 bits are a small percentage of the total clock, it is clearthat the choice of the 10-bit segment must be consistent with theexpected latency of the packet flow. The segment must be chosen suchthat the maximum latency limit for a given packet flow is always smallerthan the segment. As there can be many different packet types and eachpacket type can have different latencies, it is clear that the segmentmust be adjustable to match the packet flow being time stamped.

As latency is linked to COS for the system in this disclosure, COS datacarried with hunting packets also defines which bits are stored for the10-bit segment. It should be noted that the specification of thissegment can be accomplished in many ways, and that one of skill in theart can specify other methods of efficiency coding this time segment.

As previously mentioned, the 10-bit segment must be defined such thatboth the start time and maximum latency can fit inside the segment. FIG.5 shows the packet timeline including the start time and the maximumlatency for 2 packets. Also, please note the alias points indicated onthe drawing. As has been demonstrated in the Y2K experience, aliaspoints occur when too few bits are used to describe an event.

By making sure the start time and the maximum latency are shorter thanthe segment, the alias points can be supported. Packet 1 shows a starttime and the maximum latency both in the same segment. Packet 2 showsstart and maximum latency points in different segments. Time stampedpackets can have either situation. If the start time is defined as A,and the maximum latency is defined as B, the relationship between packet1 and packet 2 is easily seen:

For Packet 1, B>A. For packet 2, A>B:

The alias point of A is greater than B as seen in FIG. 5.

For Packet 1, the region where a packet is valid is as follows: AssumingX=the valid region and Y=invalid region, A≤X≤B. The invalid region is:B<Y, Y<A.

For Packet 2,

Valid: A≤X, X≤B Invalid: B<Y<A

Invalid user packet must be flagged or destroyed. Invalid huntingpackets must be destroyed. As is obvious to those of skill in the art,many of the previously discussed features are not needed for DNNs andshould be removed to simplify and reduce the cost of a DNN.

Hardware

The model system disclosed in this document has been optimized around alarge system that may be utilized by telecommunication carriers. Manydifferent versions of this system can be implemented with this flexiblearchitecture. Although a detailed hardware description is only shown fora switch fabric node, the same hardware design approach can be utilizedfor all the different node types encountered. The hardware design of thecustomer side of an edge node is known to those of skill in the art andwill not be discussed at length in this document. Although theimplementation is for a 10 Gig switch, this size can be scaled up ordown as required.

The switch fabric node used in this model system is a 16 port by 10 GigEthernet version that contains an SD RAM 17 to support the initialinstallation. A drawing of this node is shown in FIG. 2. Because of thehigh speeds involved each port is self-contained and is connected toother ports via intranode links. A separate processor is shown for thetransmit and receive functions provided for each port. An alternativeapproach is to combine transmit and receive functions on the sameprocessor to simplify the design. The design in the model system assumestransmit and receive modules share the same memory. An alternativeapproach would be to use separate memory for each function, but thismethod would need a high-speed bi-directional link

FIG. 6 shows a system level block diagram of switch fabric node. Receiveinputs 61 from the adjacent nodes are shown on the left side of thedrawing while transmit outputs 66 are shown on the right. These receiveand transmit signals are actually processed together in a “PHY” chip notshown on the drawing. In addition, there are external components used tointerface to the physical link such as fiber optics transceivers ortransformers not shown.

The receive signal 61 enters the receive module 62 where it is processedand then retransmitted on one or more of the 16 intranode links 64. Thelink used to connect the receiver to its own transmitter isbi-directional and is only needed if the transmit and receive modulesfor the same port do not share the same memory. It is important to keepin mind that this document describes both options and shows both optionsin the drawings; but only one of these options will be chosen duringimplementation. The intranode links 64 provide a non-blocking, spacedivision architecture. This switch is said to have a switching gain of16 as one port can transmit to as many as 16 ports. From an externalstandpoint one input actually feeds 15 outputs as packet signalsnormally do not loop back upon themselves except when virtual nodes areinvolved. Because of the high speeds involved, the receive and transmitmodules communicate with each other through an intranode link. Thetransmit module 63 accepts inputs from the 16 receive modules 62,buffers them and transmits the signals out to the physical links 66.

In addition to the receive and transmit modules, each node contains aprocessor 67 with an SD RAM 17. This processor 67, called nodecontroller, in the drawing, is used to manage system wide functions suchas OA&M support, key distribution and time management. The removable SDRAM 17 can be used to provide initial setup functions such as securitykeys, node name or number, etc. The processor 67 communicates with eachof the modules through special links going between each module and theprocessor.

FIG. 7 shows a block diagram of the receive module 62. Signals from thelink 61 enter the PHY chip 71 where all the layer 1 functions such asclock recovery and framing are supported. Management of the PHY chip 71is provided through the receive and transmit processor. The processorsalso support Layer 2 functions for each link. The decoded signals fromthe PHY chip next enter the SERDES chip 72. The SERDES chip 72 providesthe conversion from the serial link signals to a parallel interfacecompatible with the processor and memory connected to each link. SERDESand other high speed chips are available from companies such asBroadcom. How to design with these components is known to those of skillin the art.

The SERDES chips 72 are connected to a 64-bit backplane 73 that is alsoconnected to the processor 74 and memory 75. The 64-bit backplane 73 waschosen to allow all key parameters used in label translation to bestored in one word. It was also chosen to allow the processor 74 to havemore real time to perform the reads, writes, compares and other simplearithmetic functions on the packets flowing through the links. Theprocessor 74 receives a packet from the SERDES 72 connected to the linkreceive port, modifies the packet, and sends it on to one or more of thetransmit SERDES chips 76 where the packet is converted to a serial bitstream and transmitted over the intranode links 64

FIG. 8 shows the transmit module 63. The transmit module receives thepackets on the intranode links 64, processes them, and transmits themout to the next node. Packets from the intranode link 64 are received atthe SERDES 81 and converted to parallel. The packets are then stored ina FIFO (First In, First Out) register 82 where they are buffered. A QOSdecoder 83 examines the QOS bits associated with each packet andprovides a means to identify and select the higher order packets forpriority transmission. The processor 84 moves packets based on priorityfrom the intranode FIFOs 82 to the transmit FIFOs 85. The drawing shows8 output FIFOs that represent 8 output queues. In a commercial design,the number of queues is likely to be much greater.

Although the queues are shown in physical form, they may be implementedthrough the processor with special memory management software.

The key to understanding the DNN is the understanding of the dataneuron. The data neuron is a switch fabric node 14 of FIG. 6. The nodeis comprised of a receive module 62 and a transmit module 63interconnected by intranode links 64. Although the node only shows 16ports, it has many more connection points as each LSP can be considereda connection point. The transmit and receive modules are interconnectedas shown in FIG. 30. FIG. 30 is derived from FIG. 3 on page 15 ofreference 2. The dashed lines were added to show the implementation ofthe neural network using switch fabric nodes. Each bank ofinterconnections (the dashed lines) can be considered a layer. Neuralnetworks contain many layers to provide intelligence. From FIG. 30, theneuron is the receive module 62, and the synapse is the transmit module63. The synapse provides the weight function “w” which is provided usingthe packet waiting function which is part of the transmit module. Theneuron (RCV 62) is actually connected to many inputs (LSPs) and eitherpasses or blocks the signals. When the signal is passed it appears onthe intranode links 64, and connects to many other neurons through thesynapse (XMT 63) which adds the weights (delays).

The data neuron can be comprised of many virtual neurons. FIG. 32 showsa data neuron, D_(1,1), and virtual neurons v_(1,1) . . . v_(min). Eachvirtual neuron has access to only a portion of the 20-bit addressassociated with each link. When a data neuron receives a packet from anexternal link, the data neuron can determine which virtual neuron is toreceive the packet. The data neuron then assumes the identity of thevirtual neuron, and processes the packet. Virtual links exist betweenthe virtual neurons that are part of a given data neuron.

Virtual neurons interface to each other and to the host data neuronusing virtual ports. FIG. 6 shows a system block diagram of a switchfabric node. When this node is used as a data neuron, only a subset ofthe 16 ports are used to interconnect with other nodes that would bepart of the array of FIG. 31. Unused ports can be used as virtual portsby connecting input 61 to output 66. When a packet leaves transmit node63, it arrives on receive node 62 which now acts as a virtual neuron.

Each virtual link includes weights (delays) to regulate the flow ofpackets within a given data neuron. The processor in the data neuronmust be fast enough to support all the virtual neurons included in thatdata neuron.

It is important to understand that the implementation of this neuralnetwork is hardware based for simplicity. The neuron implementation canbe achieved using software running on a processor. In many cases thenumber of the signaling bits can be changed, and some of the hardwareelements of FIG. 6 can be removed to make the design more efficient.These trade-offs are well known to those of skill in the art.

The transmit module can be a source of congestion as 16 10-Gig linksfeed into one 10-Gig link.

To limit possible congestion it is necessary to eliminate extra huntingpackets as early as possible in the design. When a hunting packet isreceived, its PSN must be communicated to all ports as soon as possibleto prevent unnecessary hunting packet replication. When hunting packetsarrive at virtually the same time on more than one port, it is notpossible for the transmit module to communicate with the receive modulesin time to prevent replicated packets from arriving at the transmitmodule. It is for these reasons the transmit module must be able toprocess hunting packets fast enough to prevent blocking.

Software

FIGS. 9-16 provide the flow charts of each primary activity occurring inthe network. In addition, FIGS. 20-28 provide data structures showingthe data that must be transferred between nodes or stored on each nodeto achieve proper operation. Each operation will now be discussed:

User packets require the least amount of system resources to transport.

FIG. 9 shows the receive module. This module receives the packet, checksTime To Live (TTL) data to ensure the packet is current, translates thelabel, and sends the packet to the transmit module. FIG. 10 shows thatthe transmit module queues the packet for transmission to the next nodebased on COS. FIG. 20 shows that the user packet only needs the labeland the TTL data making it very efficient for transporting smallpayloads. The translation table of FIG. 24 shows that the new label,QOS, TTL, and the output port address, are all the data that must bestored. FIG. 17 shows a simplified flow chart for reference.

FIG. 11 shows the hunting packet. The receive module checks the huntingpacket for duplicates, checks that it is current, and forwards it to theoutput ports. FIG. 12 shows that the transmit module looks up policyinformation and may delay or even discard the packet depending on policyrules. Available bandwidth for the packet COS is checked, and if o.k.,the packet is queued for transmit.

FIG. 21 shows that the hunting packet uses the PSN as a label, and needsto carry TTL, QOS, policy, receive and transmit node numbers, and peakand average bandwidth data. Optional fields are available for additionaldata strings for hunting through more complex environments such asmulticasting, neural network functions, interdomain hunts, or hunts fornames such as domain names, etc. Also extra space is shown for thetransport of keys for encrypted networks. Secure networks can requirekeys to build a path to anything of concern.

An alternative method of using hunting packets to build a label-switchedpath is as follows:

Instead of storing the port number on each node traversed by the huntingpacket as referenced by the PSN, the method is to store the port numberon the hunting packet itself. As the hunting packet traverses thenetwork it collects an ordered list of the ports. The list is then usedto build an LSP from the called computer back to the calling computer.Alternatively, the node address could be used in lieu of the portnumber. Source routing is then used to build the LSP between thedestination computer and the source computer. These methods work wellwhen the number of nodes traversed by the LSP is kept relatively short,but can become a problem when the number of nodes is high due to thegrowing size of the hunting packet.

These alternative methods are useful when the available memory on eachnode is limited. The ordered list of nodes used for the LSP between thesource and the destination can be useful when solving complex mathproblems such as the traveling salesman problem.

FIG. 13 shows the receive module software for the setup packet. As thispacket flows through the network in the reverse direction it isimportant to keep in mind that the transport portion of the receive portis really what is being programmed.

The checking of the available bandwidth is a transmit function but mustbe done through the receive portion of the module. Once bandwidthchecking is finished, the packet can move to the transmit module (FIG.14). Again, this module will be programming the connected receive sideas both receive and transmit sections of the same port reside together.The label translation table, which is actually on the receive portion,is programmed at this point.

The setup packet is shown on FIG. 22. The PSN is shown for this address.The PSN is the same PSN of the hunting packet that built theright-of-way. This packet merely follows that right of way back to thetransmit node. The TTL is checked to ensure the packet is current. Theold TTL is used to provide a match with the hunting packet stored in thePSN reference table. This value must match, or the path will not bebuilt. QOS and Policy are stored from the previous hunting packet andare used to ensure proper setup. Peak and average bandwidth is used aspart of the check that the transmit link has sufficient bandwidth tosupport the packet flow. The setup packet also stores the label providedby the previous node. This label is programmed into the LabelTranslation Table of this node. This node will select a new label thatthis packet will transport to the next node.

It is important to keep in mind that when setup packets are used as partof a DNN, that much of the checking may not be necessary as the DNNplatform is less likely to be transporting user packets.

The teardown packet (FIG. 15) looks much like a user packet in the wayit traverses the receive portion of the node with the exception that itdeletes the translation data from the table as it leaves. In FIG. 16, itcan be seen that it adds the bandwidth back to the transmit bandwidthtable. FIG. 23 shows the teardown packet. The only additionalinformation transported is the failed node indicator. This informationis used to indicate the failure point in the system for future repair.This node is the originator of the teardown packet.

It should be noted in this embodiment, there is a total of 6 flags thattravel with the packets. These 6 flags tell each node how to processeach packet. These flags are indicated at FIG. 23.

System Design Issues

The previous section briefly discussed the flags that are used as partof the system. These flags are used to support fast and efficientprocessing of the packets by guiding the system to the propertranslation tables.

As mentioned previously, to support bidirectional LSPs it is necessaryto have two label translation tables per port. The translation tablesare shown in FIGS. 24 and 26. Operation is made simpler if these twotables can reside on the same port. When they reside on the same port,available space on the reverse label translation table can be used tostore Peak/Average Bandwidth requirements. This data is used when ateardown packet removes an LSP. Operation is simplified when the forwardtranslation table can be moved to the transmit module. This can beaccomplished if a table called “Output Port Flag Table” is added (FIG.28). This table allows user packets entering the receive module to bepassed to the transmit module by pointing the packet to the propertransmit module without translating the label.

A user packet can be branched by using a branching table in conjunctionwith the label translation table. The branching table shown in FIG. 27can be support up to 3 outputs at one node. By moving the labeltranslation table to the transmit module and using the output flagstable in FIG. 28, branching can be increased up to 16 ports. (A 16 portnode would only branch up to 15 ports.)

The Flag Table would be programmed when a setup packet moves to thetransmit module. The packet would simply set a flag as it moves throughthe module on its way to the next node. The flag would indicate whichport the setup packet entered the node. If branching was allowed, one ofthe flags shown in FIG. 104 would be set for that purpose. Flag V (shownas reserved) would be assigned to allow branching. Each additional setuppacket carrying the same PSN would set an additional flag on the flagtable (FIG. 28) and branching would occur.

Hunting in its simplest form uses the 16-bit node number as the huntobject. FIG. 3 shows a network with called party 02. This party, alsocalled the receiving or terminating node (as it receives or terminatesthe packet flow), simply responds to a match in the 16-bit RCV Nodeaddress. The hunting process can be more complex when the hunt object isnot just a node but a longer string of characters. In this case, the“Request Code” or “Info Request” sections of the hunting packet would beused. A hunt may be to a key word or phrase which may be recognized byan interested server (a server looking for the word) as in anInformation Centric Network.

In some cases, an edge node or Junctor would need to use hash tables todo recognition of longer bit strings. In this case, the Junctors mayhave to cache certain LSPs for external linking to other Domains.Interdomain hunts may involve longer waits as a hunt to a Junctor couldin turn trigger an additional hunt through an adjacent domain.

Hunts can occur through multiple Junctors. If branching is allowed(multicasting), the path right-of-ways may branch either before or afterthe Junctors depending on which path is shortest. If the hunt is for asingle called party in a different domain, the setup packet can flowthrough any of the Junctors back to the calling party.

When a hunt is to a bank of servers, multiple responses can occur aseach server may respond to the request independently. In this case, thefirst setup packet to arrive at the calling party will receive theconnection. The remaining LSPs will be blocked at the point they attemptto branch to the connection. These partial LSPs will be torn down andthe servers will be notified that they did not obtain the connection.Optionally, multiple servers may respond and be branched into a point tomultipoint connection.

DNN Platform Functionality Layers

The functionality of DNNs for problem solving can be broken down intolayers:

The lowest layer is the physical layer that contains data neurons(switch fabric nodes). The data neuron can be implemented with simplelogic sufficient to perform the neuron function, or it can be amicroprocessor that adds additional functionality. The data neuron canbe combined with a sensor such as an electromagnetic sensor that iscapable of sensing light or other forms of electromagnetic radiation, ora mechanical (pressure), or an acoustic sensor.

The data neurons can be connected together via links. The links can beexternal, as in a typical data network, or the links can be internalsuch as would be seen if the data neurons were part of an array on asingle semiconductor substrate. FIG. 31 shows a typical substratecontaining an array of data neurons, D_(1,1) . . . D_(m,n). If part ofan array, the adjacent nodes would be connected together inside thesubstrate.

The second layer involves the interconnection of the data neurons. Toachieve DNN functionality, it must be possible to interconnect any givendata neuron to other related data neuron for the desired networktopology. This interconnection is implemented through the establishmentof LSPs between selected data neurons. This method has been previouslydiscussed.

The third layer involves the normalization of the LSPs between the dataneurons. The normalization is performed by adding sufficient delay toeach path between the selected data neurons such that a fixed equaldelay exists between each data neuron needed for the problem. This stepis necessary as the propagation delay between data neurons may not beequal as it can vary depending on the physical location of each dataneuron. Delays between neurons on a substrate and those external canvary greatly. After the network is normalized, the DNN is now ready tosolve complex problems. In some cases it is possible to combine thisstep with the weight assignment discussed in the next layer.

The fourth layer involves the setup of the DNN for problem solving. Whenthe DNN is set up as an array, it will be necessary to map the points orobjects of a physical representation of the problem, onto the dataneurons.

Although the data neurons may be in a form of a two-dimensional array,it is possible to add other dimensions, or to greatly increase the sizeof the array through the use of the previously discussed virtualneurons. The array must be of sufficient size to accommodate all thepoints or objects in the problem. Problems can have a large number ofobjects, and each object must map onto a specific data neuron. When thearray is larger than the number of objects, it can be considered as agrid with each intersection point a data neuron. A common technique isto “snap” the objects to the grid. In order for the objects to besnapped to the grid, they must first be put into a form where theirrelationship can easily be displayed, such as in terms of co-ordinates(x,y,z). Once in this form, the objects can be mapped to the DNN. Largecomplex objects can be expressed as several data neurons linked togetherwith no delay in between. Previously collected data can now be writtento each data neuron. The data can be information relating to each node,or can be the relationships between nodes. Relationships can bephysical, such as time or distance, can be mathematical, or can besubjective.

Once snapped, the links are added between the objects. The links are inthe form of LSPs, and can traverse multiple nodes. Weights are added toeach link to express the relationship between the two objects connectedby the link. If not already in time, the weights are converted to a timedelay value that is stored in a memory associated with the link.

The fifth layer involves the solving of the problem. This layer can beinitialized only after the previous four layers have been completed. Thefifth layer requires the running of one or more hunts. The hunt isusually triggered by a request made of the network to identify a paththrough the array. As the path is identified, information is stored.Typical information may include the number objects (nodes) traversed,the order of the objects, or the total time to traverse.

There are two types of hunts that could be encountered. The linear huntis the most common. The purpose of the linear hunt is to discover anoptimized path between a source and a destination. (previouslydiscussed). The second type is the recursive hunt. In this hunt,specific nodes must be traversed, but the order that the nodes aretraversed may be the variable to be solved. For example, the order canbe changed to minimize the total time used. Also, additional nodes maybe traversed to reduce total time elapsed. This functionality is knownto those of skill in the art, and is used for solving a travelingsalesman problem. This type of problem is discussed on page 32 ofreference 1 (Fig. A5). Other types of problems solved using neuralnetworks are seen in Fig. A.

The best way to understand this novel architecture is by example: If onewanted to move men or material between locations (terminals) onairplanes, trains, or trucks (links), the system would operate asfollows: The source would transmit a hunting packet toward thedestination. The hunting packet would travel over links following eachpathway through intermediate points such as airports, train stations, orfreight depots with delays added based on weather conditions, cost,travel time, congestion, etc. Each terminal would check its availableresources and then forward the hunting packet to the next terminal. TTLinformation would be taken into account. Once the hunting packet arrivesat the destination, the destination would either accept or ignore therequest based on its capabilities. The destination may receive multiplehunting packets, each with slightly different metrics. Once anacceptable hunting packet is received, the destination would transmit asetup packet into the network. This packet would perform the function ofbuying tickets, booking flights, reserving space, etc. as the packettravels back to the source. When the setup packet arrives at the source,it would contain the information necessary for shipment.

There are many advantages to this type of functionality. Each terminalmanages its own resources independently without knowledge of the otherterminals. Congested terminals simply ignore hunting packets. Delays(weights) can be added independently by third parties so they are out ofthe control by the managers of the terminals. The optimum route isalways chosen as each terminal in the path has its say along the route.As the data follows the same pathways as the cargo, changes and updatescan be made instantly without the need of third parties gettinginvolved. Changes can be made on the fly taking into account weather,equipment failures, etc. Finally, the link established using the setuppacket traverses all the required terminals between the source and thedestination providing a method for any of the terminals along the way toprovide instant updates on the shipment. Also, the link is secure as itcannot be accessed by those other than the parties directly involved.

Another advantage is the interconnection of terminals can take placeover traditional IP networks. Paths can be fashioned out of anyavailable medium including VPNs on IP. As paths on VPNs tend to beslower and less efficient than LSPs, delays must be scaled up to takeinto account latency variations.

Automatic, Secure Operation

The OSI layer 4 network of this invention can be consideredfundamentally secure for the following reasons: This networkcommunicates at layer 4, directly below the session layer used bycomputers to communicate, so the user's computers have direct networkcontrol for making connections. Prior art networks are layer 3, meaningthere is a gap in the OSI layers that can be exploited by the hackers togive them access to the target computers via their IP addresses. Withthis access the hackers simply hammer the target computer until theybreak in. As the IP address is known, hackers can institute a denial ofservice (DoS) attack overwhelming the target. With this layer 4 network,the hackers have no access to the target computer unless the targetcomputer agrees. In other words, the hacker would have to knowunavailable information about the target, and would need to convince thenetwork to make the connection to the target, and get the target toaccept the connection. For that to happen, the hacker would have to knowunavailable information about the target such as its name or securitycodes to convince it to accept the connection. Using policy constraints,the hackers could be completely locked out from secure locations, evenif the hackers knew all the required information. If this neural networkfunctionality is needed to operate on an IP network, it would benecessary to add additional security such as additional keys, or anencrypted VPN to prevent hackers from accessing the neural network. Toisolate the network from hacked computers it may be necessary to use aseparate box from the user's computer to deny the hacker access to thenetwork logic.

The DNN of FIG. 1 is designed to operate automatically and securely,with teaching provided through the OA&M terminals 13 that incorporatethe capabilities of the switch fabric nodes 14. Because of theimportance of the OA&M terminals, it is necessary to keep them secureand separate from the Internet. Access needs to be limited to preventphysical access by hackers or unhappy employees. The OA&M terminals runsoftware that automatically supports policy and QOS for the domain.Policy or QOS support can also come from the other nodes in the domain,but needs to be separated to ensure that the policy setting occursindependently from the path selection. Data neurons, as well as externalcomputers, can generate or receive hunting packets, giving the systemthe ability to operate independently from external factors such as humanintervention or security threats. Other human interfaces can be providedin lieu of the OA&M terminals, such as optical or acoustic sensors andactuators, for better human interaction. Each of the following networkfunctions need to operate independently to ensure network security:

-   -   Path setup and teardown    -   Policy setup and distribution    -   QOS control    -   TTL assignment

When these four functions operate independently, the network can operateautomatically and securely, and not be affected by any single threat.

Robotics

The DNN architecture is well suited for robotics as data can becollected through the sensors, passed to the processing portion, andconverted to commands which are transmitted to the actuators.Communication would be through the aforementioned human interface.

An important advantage of this neural network is that it is designedaround the management of packet flows. Data from sensors flows throughthe network to a control point. Monitoring of this data is best seen byexample: If a sensor produced packets proportional to pressure, in otherwords: the higher the pressure, the greater the bandwidth, the networkwould be able to sense the activity through the packet flow bandwidth.The network would now be able set thresholds and monitor activitydirectly. When a packet flow exceeded a set threshold the affectedneurons in the network would respond to correct the condition byrebuilding the connection. Network instability can be intentionallycreated to cause network changes. The network would then need to utilizeresources to return the network to stability. This functionality can becalled direct network stimulation as these packet flows directlystimulate the network into making changes. Stimulation of this type canbe thought of as causing discomfort or pain to the network. In effect,the network can be taught to feel and react to pain. Sensing pain is animportant tool for self learning and is especially valuable in robotics.

Sensor Networks

SRP Network technology is well suited for sensor networks as the sensorscan be setup as in the Robotics section.

Information Centric Networks

Content Centric Networks

An excellent application for the previously discussed SRP Networktechnology is supporting Information Centric Networks (ICN) and ContentCentric Networks (CCN). One of skill in the art can easily see that theHunting Packet can carry the Key Word used to locate availableinformation from a server. The network would operate as follows:

A user would initiate a hunt for a Key Word. The Hunting Packet wouldarrive at one or more servers. If the server was interested, it wouldaccept the connection request. When one or more servers accepted therequest, a point to multipoint connection (branching) would be formed.More information would be requested by the user which would flow throughthe point to multipoint connection just established. When a server lostinterest, it would transmit a Teardown Packet which would remove it fromthe connection. At some later stage in the process, a server couldtransmit data or follow-on questions back to the user.

A network of this type is totally secure as the user has no knowledge ofthe servers and vice versa. Data transmitted by one server is not seenby the other servers. Large amounts of data can be transmittedanonymously and securely as only the involved nodes have any knowledgeof the connection that traverses that node. As a layer 4 connection isestablished, the only latency seen is the latency due to distance.

Power Grid Control

An important application for a neural network is in the control of thepower grid. The power grid (also called the Smart Grid, or theElectrical Grid) is a complex network used to control our electricalsystem. Reference 3 shows an example of a possible computer basedcontrol of this complex network. Some requirements of this network arelisted below:

1. Precise time alignment between nodes (generators) to allow phaseadjustment.

2. Fast reliable communication to correct for changes in generators orloads.

3. The ability to rebalance quickly when new generators or loads appear.

4. The ability to drop certain loads in times of stress.

5. No single points of failure.

6. Network security to prevent hacking.

7. Seamless, secure interconnection of multiple service providers.

One of skill in the art can easily see that each of these requirementshas been previously addressed in this application. Associating a dataneuron with each network element such as a generator or a substationwill allow the neurons to collect information and pass it through thenetwork. Associating delay with power levels provides a method for theneural network to balance power loading at each connection point as theweighting associated with the delay will allow the network to selectoptimized transmission paths.

The interconnection network shown in Reference 3 (FIG. 22, and Col. 14,Lines 10-14) uses an IP network, leaving the power grid control systemvulnerable to hacking. The power grid has become a prime target forsabotage and must be protected to ensure stability of our nation. Theneural network of this application can be easily hardened through thetechniques previously discussed. To ensure security, each computerconnected to the neural network must not also be connected to othernetworks as the external connection can be used by hackers.

Simplified Explanation of Path Acquisition and Setup.

A packet is received by an edge node. No current path exists so theoriginating edge node builds a hunting packet. This packet contains anaddress that the terminating node can respond to. The packet alsocontains metric information to identify minimum requirements for QOS forthe path to the terminating node. The hunting packet is transmitted intothe network. The adjacent node receives the hunting packet and checksthe packet serial number (PSN), a unique number assigned by theoriginating edge node (FIG. 18). If the number was previously stored,the packet is a duplicate and is destroyed. If the number is new to thenode, it is stored. Once checked, the packet is then transmitted on allthe ports compatible with the metrics stored on the hunting packet. Thisaction continues through the network until the hunting packet arrives atthe terminating node. At this point, the hunting packet has exposed apath right-of-way from the originating node to the terminating node. Theterminating node builds a setup packet using the information, includingPSN and metrics from the hunting packet, assigns a label from a table ofavailable labels, and transmits the packet back down the link that thehunting packet arrived. The setup packet is transmitted to the firstadjacent node on the path right-of-way FIG. 19). The node receives thepacket, looks up data stored against the PSN of said hunting packetincluding the port address that the hunting packet arrived, and metrics.

The node checks the metrics against the port availability. If the portcan support the packet flow identified by the hunting packet, the nodewill assign a label from a table of available labels. The node will thenbuild a label translation table with the newly assigned label as theaddress and the label included in the setup packet as part of the datastored. The data stored in the table will also include the port addressthat the setup packet arrived, along with the QOS from the huntingpacket. The first adjacent node then transmits the setup packet out thesame port that the hunting packet arrived. The setup packet willcontinue down the path right-of-way all the way back to the originatingnode. The final step is the originating node is provided a label to thenewly created LSP to the target node. Not only was the path createdautomatically at wire speed, but it was the most optimum path availablesubject to required metrics of the packet flow.

Although the system and method taught in this embodiment is of a largelayer 4 MPLS type packet network, the methods taught in this inventionapply to any network with multiple nodes including Information orContent Centric Networks. It will be obvious to one of skill in the artthat this invention can be practiced to expose and program an optimumpath through communication networks including optical, ad-hoc, wirelessor satellite networks, especially as these networks have nodes that movearound and may not be available at all times. The methods taught in thisinvention can be used to program and manage any data routing device withmultiple ports or radio channels to provide optimized paths for packetflows. Although this invention uses label switching, it will be obviousto those of skill in the art that the methods taught here can be appliedto other data networks including those networks with fixed addressessuch as radio communication networks, or IP networks.

These approaches can be used to program large and small voice and datanetworks where a choice among multiple options must be performed. Themethods taught in this invention correct a deficiency in today's datanetworks relating to multicasting as no method that is practical andefficient has been available for building multicasting LSPs in MPLS,Frame Relay, or ATM networks today.

The invention claimed is:
 1. A method of synthesizing a neural networkfrom a communications network containing a plurality of interconnectednodes, where at least one node contains one or more transmitters and oneor more receivers, and where each node corresponds to one or moreneurons of the neural network comprising: receiving at a first node acommunications request from another node of the network; initiating atime delay, not associated with network congestion, or the processing oremulation of time varying signals, in response to the reception of thecommunications request, where the time delay is used as a weightfunction for the corresponding neural network, and is also used tocontribute to the overall latency of a possible path traversing multiplenodes across the communications network, where the path would be usedfor the transport of signals unaltered through modulation ordemodulation; transmitting after the time delay, at least a portion ofthe communications request to at least a second node of the network toexpose the possible path for use by the corresponding neural network;and selecting by the neural network, a path for the transport ofcommunications, where multiple paths exist, by combining the weightsassociated with each node of the network traversed by the path, wherethe nodes only use knowledge of their immediate neighbors and not of thenetwork beyond.
 2. The method of claim 1 where the communicationsnetwork is a radio communications network.
 3. The method of claim 1where the communications network is an optical communications network.4. The method of claim 1 where the communications network is a packetdata network.
 5. The method of claim 4 where the packet data network isconnection oriented.
 6. A communications system comprising a neuralnetwork synthesized from a communications network that includes aplurality of interconnected nodes, where at least one node contains oneor more transmitters and one or more receivers, and where each nodecorresponds to one or more neurons of the neural network comprising: afirst node with software or circuitry capable of receiving acommunications request from another node of the network; the first nodefurther capable of initiating a time delay, not associated with networkcongestion, or the processing or emulation of time varying signals, inresponse to the reception of the communications request, where the timedelay is used as a weight function for the corresponding neural network,and also used to contribute to the overall latency of a possible pathtraversing multiple nodes across the network, where the path would beused for the transport of signals unaltered through modulation ordemodulation; the first node further capable of transmitting, after thetime delay, at least a portion of the communications request to at leasta second node of the network to expose the possible path for use by thecorresponding neural network; and the neural network capable ofselecting a path for the transport of communications, where multiplepossible paths exist, by combining the weights associated with each nodeof the network traversed by the path, where the nodes only use knowledgeof their immediate neighbors and not of the network beyond.
 7. Thesystem of claim 6 where the communications network is a radiocommunications network.
 8. The system of claim 6 where thecommunications network is an optical communications network.
 9. Thesystem of claim 6 where the communications network is a packet datanetwork.
 10. The system of claim 9 where the packet data network isconnection oriented.